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I Abstract 

We address optimal placement of vehicles with simple motion to intercept a mobile target 
that arrives stochastically on a line segment. The optimality of vehicle placement is measured 
through a cost function associated with intercepting the target. With a single vehicle, we as- 
sume that the target moves (i) with fixed speed and in a fixed direction perpendicular to the line 
segment, or (ii) to maximize the distance from the line segment, or (iii) to maximize intercept 
time. In each case, we show that the cost function is strictly convex, its gradient is smooth, 
and the optimal vehicle placement is obtained by a standard gradient-based optimization tech- 
nique. With multiple vehicles, we assume that the target moves with fixed speed and in a 
' fixed direction perpendicular to the line segment. We present a discrete time partitioning and 

Q gradient-based algorithm, and characterize conditions under which the algorithm asymptotically 
leads the vehicles to a set of critical configurations of the cost function. 

■3 

g 1 Introduction 

Vehicle placement to provide optimal coverage has received lot of recent attention. This paper ad- 
dresses vehicle placement scenarios with the novelty of intercepting a mobile target generated ran- 
domly on a segment. Applications of this work are envisioned in border patrol wherein unmanned 
vehicles are placed to optimally intercept moving targets that cross a region under surveillance 
(cf. IGirard et al.(2004)[ [Siechtman et al.(2008)| ). 
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Vehicle placement problems are analogous to geometric location problems, wherein given a set 
cn of static points, the goal is to find supply locations that minimize a cost function of the distance 
from each point to its nearest supply location (cf. [Zemel(1984)| ). For a single vehicle, the ex- 
pected distance to a point that is randomly generated via a probability density function, is given 
^ by the continuous 1-median function. The 1-median function is minimized by a point termed as 
• 'H the median (cf. [Fekete et al.(2005)] ). For multiple distinct vehicle locations, the expected distance 
rN between a randomly generated point and one of the locations is known as the continuous multi- 
median function (cf. [Drezner(1995)] ). For more than one location, the multi- median function is 
non-convex, and thus determining locations that minimize the multi-median function is hard in the 
general case. [Cortes et al.(2004)] addressed a distributed version of a partition and gradient based 
procedure, known as the Lloyd algorithm, for deploying multiple robots in a region to optimize 
a multi-median cost function. [Schwager et al.(2009)] provided an adaptive control law to enable 

*This material is based upon work supported in part by ARO MURI Award W911NF-05- 1-0219 and ONR Award 
N00014-07- 1-0721 and by the Institute for Collaborative Biotechnologies through the grant DAAD19-03-D-0004 from 
the U.S. Army Research Office. A preliminary version of this work titled "Vehicle Placement to Intercept Moving 
Targets" was presented at the 2010 American Control Conference, Baltimore, MD, USA. 

^S. D. Bopardikar and F. BuUo are with the Center for Control, Dynamical Systems and Computation, University 
of California at Santa Barbara, Santa Barbara, CA 93106, USA; email: {shaunak, bullo}@engineering. ucsb.edu. S. L. 
Smith is with the Department of Electrical and Computer Engineering, University of Waterloo, Waterloo ON, N2L 
3G1 Canada; email: Stephen. smith@uwaterloo.ca 



1 



robots to approximate the density function from sensor measurements. [Martinez and Bullo(2006)] 
presented motion coordination algorithms to steer a mobile sensor network to an optimal place- 
ment. [Kwok and Martmez(20l"0)] presented a coverage algorithm for vehicles in a river environ- 
ment. Related forms of the cost function have also appeared in disciplines such as vector quantiza- 
tion, signal processing and numerical integration (cf. [Gray and NeuhofF(1998)" , |Du et al.(1999)| ). 

In mobile target scenarios, the cost for the vehicle is a function of relative locations, speeds and 
motion constraints considered. For an adversarial target, the optimal vehicle motion is obtained 
by solving a min-max pursuit-evasion game, in which the target seeks to maximize while the 
vehicle seeks to minimize a certain cost function. The vehicle strategy is a version of the classic 
proportional navigation guidance law (cf. [Gu elman(1971)| ). With constraints such as a wall in 
the playing space or non-zero capture distance, strategies with optimal intercept time have been 
derived in |Isaacs(1965)| and in |Pachter(1987)| . 

We consider a line segment on which a mobile target is generated via a known spatial probability 
density and one or multiple vehicles seek to intercept it. Knowledge about the density is a standard 
assumption in search problems (cf. [Stone(1975)| ). The goal is to determine vehicle placements that 
minimize a cost function associated with the target motion. With a single vehicle, we consider a 
class of cost functions and establish its convexity, its smoothness and the existence of a unique 
global minimizer. We show that the cost functions associated with the target moving with fixed 
speed and in a fixed direction perpendicular to the line segment, and with the target seeking to 
maximize the distance from the segment, fall in the class of cost functions that we have analyzed. 
The cost function for target motion that maximizes the intercept time is shown to be proportional 
to the continuous 1-median function. With multiple vehicles and the target moving with fixed 
speed perpendicular to the line segment, we first provide an algorithm to partition the line segment 
among the vehicles and characterize its properties. With the expected intercept time as the cost, we 
propose a Lloyd algorithm in which every vehicle computes its partition and descends the gradient 
of the cost computed over its partition. We characterize conditions under which the vehicles 
asymptotically reach a set of critical configurations. 

In [Bopardikar et al.(2010)| , we addressed optimal placement for a single vehicle with uniformly 
generated targets that have fixed speed and direction. This paper extends our work to include 
non-uniform generation density, adversarial target motion, and multiple vehicle scenario. Exist- 
ing analyses of Lloyd algorithms (cf. [Cortes et al.(2004) Du et al.(1999)[ ) do not apply to this 
formulation due to a different form of the cost function. 

This paper is organized as follows. The problem is formulated in Section [2j Single vehicle 
scenarios are addressed in Section [S] The multiple vehicle scenario is addressed in Section [4] The 
proofs of Lemmas 3.1, 4.5 and |4.8| are presented in the Appendix. 



2 Problem Statement 

We consider vehicles modeled with single integrator dynamics having unit speed. A target is 
generated at a random position (x,0) on the segment G := [0,M^] x {0}, termed the generator, 
via a specified probability density function cp : [0, W] — >• M>o. We assume that the density (p is 
bounded, i.e., there exists an M > such that (/)(x) < M, G [0,VF]. The target moves with 
bounded speed v < 1, and is intercepted or captured if a vehicle and the target are at the same 
point. We assume that the vehicles can sense the instantaneous position and velocity vector of the 
target. Target velocity information may be obtained using Doppler-based methods. The goal is 
to determine vehicle placements and corresponding capture motions that minimize a certain cost 
function based on the maneuvering abilities of the target. We consider the following cases. 
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2.1 Single Vehicle Case 



We determine a location p G M x M>o that minimizes Cexp '■ ^ x M>o 



given by 



rW 

^^cxp(p) := / C{p 
Jo 



x)(j){x)dx, 



where C : M x ]R>o x [0, W] — )• M>o is an appropriately defined cost of the vehicle position p. In 
what follows, we consider the following target motions. 

(i) Constrained target: We assume that the target is constrained to move in the positive Y- 
direction with fixed speed v < 1. From [Bopardikar et al.(2010)| , the cost function C is 

V(l-t'2)(X-x)2+y2 yY 



T{p,x) 
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where the quantity 1 arises from normalizing the vehicle speed to unity, p := {X,Y) and T is the 
time taken for the vehicle to intercept the constrained target. 

(ii) Adversarial target: We consider a differential pursuit evasion game in which the target 
(evader) seeks to maximize and the vehicle (pursuer) seeks to minimize any one of the following 
cost functions. 

(a) Expected vertical height: The cost function C is the vertical height H(p, x), i.e., the distance 
of the target from the generator in the positive Y direction, when the target is intercepted (cf. 
Figure [T]). 

(b) Expected intercept time: The cost function C is the time interval Ti(p, x) before the target 
is intercepted (cf. Figure [T]). In this formulation, we also assume that the target does not go below 
the X-axis. 

The motions of the target and the vehicle are obtained from the solution of these differential 



games and will be addressed, along with formulae for H and Ti, in Section 3.2 




W 



Figure 1: Adversarial target scenario. The vertical height H is the distance of the intercept point / 
from the generator. Due to unit speed of the vehicle, the intercept time Ti is equal to the distance 
covered by p until the target is intercepted. 



2.2 Multiple Vehicles Case 

We assume that the target translates in the positive y-direction with speed v < 1. As shown in 
Figure [2| given m > 2 vehicles having complete communication, the goal is to determine vehicle 
locations Pi G [0, W] x M>o, for every i E {!,..., m}, that minimize the expected constrained travel 
time given by 

Teycpipi, . . . , Pm) ■■= / min T{pi, x)(p{x)dx, (3) 

Jo ie{l,...,m} 
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where T{pi,x) is given by Eq. 




W 

Figure 2: Intercepting a target moving with fixed speed v perpendicular to the generator. 
Remark 2.1 (Adversarial target scenarios) The adversarial target counterparts of the mul- 



tiple vehicle case are difficult to analyze theoretically. Section 4.4 provides some insight into the 
scenarios. 

3 Single Vehicle Scenarios 

In this section, we address optimal placement for a single vehicle in the scenarios mentioned in 
Section 12.11 



3.1 Cost functions for Expected Constrained Travel Time and Expected Verti- 
cal Height 

We analyze cost functions given by Eq. ([T]), where the function C has the form 

C{X, Y, x) := a^/b{X - xf + - cY, (4) 

and a, 6, and c are positive constants, with a > c. The constrained travel time T (cf. Eq. Q) has 
this form and we will show that the vertical height H also has this form in Sectio n |3.2[ 

Using C as defined in Eq. Q , the partial derivatives of Cexp {X, Y) from Eq. ([T]) are given by 

8C.,_^ (5) 



dx Jo ^b{x - xY + y2 

^ = aYr dx-c (6) 

dY Jo ^h{X - xY + y2 • ^ ' 

We first establish strict convexity of Cexp- 

Lemma 3.1 (Strict convexity of expected cost) In the domain ]0, H^[xM>0; the expected cost 
Cc^p{X, Y) 

(i) is continuous and convex in X and Y , and 
(a) has a unique minimizer. 
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Statement (i) of Lemma 3.1 involves showing that the Hessian matrix of C with respect to 
X and Y is positive semi-definite. The existence of a minimizer is estabhshed by showing that 
the partial derivatives of C with respect to X and Y vanish inside ]0, VF[ x M>o. The uniqueness 
is established by assuming two distinct minimizers, using the convexity of C and the necessary 
conditions for the two distinct locations to be minima to reach a contradiction. 

Lemma |3 . 1 1 leads to the main result. 

Theorem 3.2 (Minimizing expected cost) From any initial vehicle location in M x M>o o,nd 
for any pobability density function (f), assume that the vehicle motion obeys 

Pit) = -^{pm (7) 

The following statements hold: 
(i) the vehicle position p(t) remains in [0,W] x ]R>o at all times, and 
(a) the vehicle position p(t) converges to the unique global minimizer o/Cgxp- 
Theorem 3.2 answers the problem of minimizing the expected value of T, given by Eq. with 



a := 1/(1 — v^), b := (1 — f^) and c := v/{l — v'^), and a > c. Except for special cases such as in 
Remark 3.3, it is difficult to provide analytical expressions for the minimizer p* of Texp(p*). 



Remark 3.3 (Equal target and vehicle speeds) If the target and the vehicle have equal speeds, 
the optimal placement in X which minimizes Texp is at the centroid of the distribution 0, with the 
optimal Y given by 

X* = y ^{x)xdx; Y* = J J (l){x){X* - x)^dx. □ 
3.2 Optimal Placement for Adversarial Target 



We now address the differential pursuit-evasion games stated in case (ii) of Section 2.1, and deter- 
mine optimal vehicle placements. 

3.2.1 Minimizing the Expected Vertical Height 

Given an ordered pair of distinct points {qi, q2} in a plane and a scalar AG [0, 1[, Apollonius circle 
(cf. [Isaacs(1965)| ) is the set of points w in the plane that satisfy ||q2 — w|| = A||qi — vif||. Letting 
the pursuer position p =: qi, the target (evader) position be q2 and v =: A, the following is an 
established result. 

Proposition 3.4 (Apollonius circle during pursuit) If the pursuer and the evader both travel 
straight toward a point U on the Apollonius circle, then any new such circle, obtained from a pair of 
simultaneous intermediate positions of the pursuer and the evader, is tangent to the original circle 
at U, and is contained in the original circle. 

For any evader strategy, the pursuit strategy that minimizes the vertical height (cf. [Isaacs(1965)] ) 
is to choose the pursuer's velocity vector such that the line joining the pursuer and the evader re- 
mains parallel at all times to the line joining their initial locations, while reducing the distance. 
So, for optimal vehicle placement, it suffices to determine the optimal evader strategy. Algorithm [T] 
summarizes the optimal evader strategy, shown in Figure [3] 

The following result is immediate from Proposition |3.4[ 
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Algorithm 1: Move towards top-most 



Assumes: Pursuer at {X,Y). Evader at (x,0). 
1 Compute center and radius of the Apollonius circle: 

V 



^ V 1 — ' 1 — ^2 



R := y^{X-x)'^ + Y\ 

1 — f ^ 

2 Move towards tlie point {Ox, Oy + R) with speed v. 




Figure 3: The evader strategy that maximizes H is to move towards the top- most point on the 
Apollonius circle drawn initially. 

Lemma 3.5 (Optimality of Move towards top-most) The strategy move towards top-most 
is the evader's optimal strategy and the optimal vertical height is 

H{X, Y, x) = ^(X-x)2 + y2 



y2 I — y2 



Comparing the expression for H given by Lemma 3.5 with the definition of C in Eq. Q, we have 



3.2 



a := v/{l — v'^), b := 1 and c := w^/ (1 — and a > c since v < 1. Thus, by applying Theorem 
we obtain the following result. 

Theorem 3.6 (Minimizing expected height) From an initial location inMxM>o, assume that 
the vehicle motion obeys Eq. ^ with Cexp replaced by -ffexp; then the vehicle position p(i) converges 
to the unique global minimizer of Hexp 

3.2.2 Minimizing the Expected Intercept Time 

The underlying differential game in this formulation is the classic wall pursuit game (cf. |Isaacs(1965)] ). 
We present the main result for completeness. 

Lemma 3.7 (Wall Pursuit game) The evader strategy that maximizes the intercept time is to 
move towards the furthest point of the Apollonius circle on the X-axis. 

This optimal evader strategy is illustrated i n Figure [4| Now, giv en a convex region Q C M and a 
density function ^ : Q — )• M>o, the median (cf. [Fekete et al.(2005)| ) is the unique global minimizer 
p* of /p \p — z\ilj{z)dz. 
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Figure 4: The evader strategy that maximizes Ti is to move towards the furthest point on the 
Apollonius circle drawn initially. 

We now present the main result of this section. 

Theorem 3.8 (Optimality of the Median) The median of the region [0, W] x {0} with the den- 
sity function (p uniquely minimizes the expected intercept time. 



Proof: From Lemma 3.7 and Pythagoras theorem, 



X — vX 



1-v 



X 



where R is the radius of the Apollonius circle drawn at the initial instant. Since pursuer placement 
on the X-axis results into decreasing the intercept time Ti, we have 



Ticxp(X,0) 



v + 3 



w 



\X — x\(p{x)dx, 



which is minimized uniquely by the median. 



4 The Case of Multiple Vehicles 

We now address the multi- vehicle case from Section [22 



4.1 Dominance Region Partition 

We introduce a generator partitioning procedure by defining dominance regions between each pair 
of vehicle^ We will see that the resulting partition allows us to write the cost in Eq. ([3| in a 
simplified form as in Eq. 

Definition 4.1 (Pairwise dominance region) For i,j E {l,...,m}, the pairwise dominance 
region Uij C [0, W] of Pi with respect to pj is the set of initial target locations for which Pi takes 
lesser time to intercept the target than pj: 

Uij := {xe [0,W]\T{p^,x) <T{pj,x)}. 

^Here, a partition of [0, W] is a collection {Vi, . . . , Vm} of subsets of [0, W] such that Vi U . . . U Vm = [0, W] and 
Vi n Vj has zero length, for all distinct i,j. 
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We now describe a procedure (summarized in Algorithm [2]) to determine Uij. Without loss of 
generality, assume that Xi < Xj. li Yi = Yj, i.e., the vehicles are at the same distance from the 
generator, then Uij is the piece of G that lies in the half-plane that is formed by the perpendicular 
bisector of the segment joining pi and pj and which contains pi. Now if 1^ <Yj, then we look for 
points (x,0) in G for which T{pi,x) < T{pj,x). By setting (1 — v"^) =: b, Eq. ^ gives 

^JbiXi - x)^ + y.2 - vY < ^b{Xj - x)2 + y/ - vYj. (8) 

Eq. ^ simplifies to a quadratic in x having real roots, which provides at most two points for the 
boundary between Uij and Uji. To determine these boundary points, consider the perpendicular 
bisector of the segment joining pi and pj, as shown in Figure [5] We look for points Ai and A2 on 




Figure 5: Pairwise dominance regions. The solid and dashed dominance regions belong to the 
square (red) and the triangle (green) vehicles respectively. 

this bisector such that the distances of these points from the real line is v times their respective 
distances from the vehicles. This leads to the following quadratic in i 

4(sin2 e - v'^)e + ^{Yi + Yj) sinOe = -{Yi + Y^f + v^\\pi - pjf, 

where i and 9 := arctan2((l^- — Yi), {Xj — Xj)) + 7r/2 are as shown in Figure [5j Let £1 and £2 be the 
roots of the above quadratic. Then the Y-coordinates of the candidate boundary points Ai and A2 
are given by 

[yu y2f = [1, lf(Y, + Yj)/2 + [£i, ^al^sm^. 

Now, Ai and A2 are both boundary points if and only if both have positive Y-coordinates. It can 
be shown that there exists at least one among them which has positive y-coordinate. There arise 
two cases: 

(i) If there are two candidate points Ai and A2 (as in Figure [s]), then we look at their cor- 
responding X coordinates, {xi,X2) given by Step 9. For (x,0) £ G Ci [xi,X2] x {0}, we have 
T{pi,x) < T{pj,x), and thus Uij is G n [xi,X2] x {0}. 

(ii) If there is only one candidate point Ai, then we look at its X coordinate, xi given by Step 
13. By assumption Xi < Xj, and hence for (x, 0) G Gn [—00, xi] x {0}, we have T{pi, x) < T{pj,x) 
and thus Uij is G fl [— cxd,xi] x {0}. 

Thus, we have established the following property. 

Proposition 4.2 (Pairwise dominance region) Given distinct locations Pi = {Xi,Yi), pj = 
{Xj,Yj), if a target arrives at (x,0), where x G Uij generated by Algorithm^ then T{pi,x) < 
T{pj,x). 
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Algorithm 2: Pairwise Dominance Region 



Assumes: Distinct pj = {Xi,Yi), pj = {Xj,Yj] 
1 if 1^ 



Yj, then 



[0,{Xi + Xj)/2], iiX^<X, 
[{Xi + Xj)/2,W], iiXi>Xj 



3 else 

4 



' := arctan2(yj - Yi, Xj - Xi) + Tr/2 
12 := two roots of = 4(sin^(6') - v'^)f 



+4{Y, + Yj) sm{e)£ + {Yi + YjY - 

yi,2 ■•= (y^ + yj)/2 + sin(0)£i,2 

if yi > and 2/2 > then 

xi,2 ■■= {Xi + Xj)/2 + cos(^)£i,2 



Pi I 



if Y. < Y 



ifYi>Yj. 



J [0,w]n[xux2], 

\[0,W]\]xi,X2l 

else 

k := index in {1,2} for which yt > 
X := {Xi + Xj)/2 + ek cos{9) 

[[0,1^] n]-oo,x], ifx, <x 



[o,w] n [x,+oo[, 



if Xi > Xi 



Similar to pairwise dominance regions, we introduce the concept of dominance region Vi G 
^([O, W]) for the ith vehicle, for every i G {1, . . . ,m}, which is the set of X-coordinates of target 
locations for which pi takes the minimum time to intercept of all vehicles. 

Assuming complete communication between vehicles. Algorithm [2] is extended to determine the 
dominance region for a vehicle by (i) determining pairwise dominance regions between vehicles and, 
(ii) taking intersection of all pairwise dominance regions, as presented in Algorithm ^ 



Algorithm 3: Dominance 


region 


Assumes: Distinct locations {pi, . . . , Pm}- 


1 foreach vehicle j G {1, • • • 


m} \ {i], do 


2 1^ Determine Uij using Al 


^orithm pi 


3 Vj = nj=i,...,mjyi ! 





Algorithm [3] with three vehicles is illustrated in Figure [6| The next result follows due to disjoint 
interiors of dominance regions, and due to Proposition |4.2[ 

Proposition 4.3 (Optimality of dominance regions) Given distinct vehicle positions and a 
target arrival, 

(i) the dominance regions generated by Algorithm^ form a partition of the generator. 

(ii) The time taken to reach the target is minimized by the vehicle whose dominance region 
contains the target arrival location. 
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Pi 



Figure 6: Algorithm [3] with three vehicles. The thick solid, the dashed and the thin solid dominance 
regions belong to the square (red), the triangle (green) and the round (blue) vehicles, respectively. 

The dominance region of a vehicle may be empty if the vehicle is very far from the generating 
line as compared to the other vehicles (cf . first part of Figure [s]) . Conversely, all vehicles have 
non-empty dominance regions when they are all in [0, W] x M>o and have the same ^-coordinates. 

Since the dominance regions are set- valued functions of vehicle positions, we now provide some 
background on continuity of set-valued functions, and establish continuity of the dominance regions. 
This property will be used to analyze our gradient-based procedure. Let £ := [0,14^] x M>o, let 
■p([0, W]) be the set of all subsets of [0, W], let B{r) be the closed ball of radius r around the origin, 
and let + denote the Minkowski sum of two sets. The domain of a set-valued map F : X ^ Z is 
the set of all q G X such that F(q) 7^ 0. F is upper (resp. lower) semi- continuous in its domain if, 
for every q in its domain and for every e > 0, there exists a S > such that for every z E q + 13{6), 
F{z) C F{q) + B{e) (resp. F(q) C F{z) + B[e)). F is continuous if it is both upper and lower 
semi-continuous . 

The pairwise dominance region between pj and pj is a set valued function Uij : E'^ \ Sij ^ 
7^([0, W]), where Sij C S'^ is the set of coincident locations for pj and pj. Similarly, the dominance 
region for vehicle i is a set- valued map Vi : \ Si ^ ^([0,1^]), where Si C is the set of 
vehicle locations in which at least one other vehicle is coincident with pj. We now show that the 
dominance regions vary continuously with the vehicle positions. 

Proposition 4.4 (Continuity of dominance regions) (i) For every distinct i and j in the set 

{1, . . . , m}, the set valued map Uij is continuous in S'^ \ Sij. 

(a) For each vehicle i G {1, • • • ,m}, the set valued map Vi is continuous on its domain. 

Proof: The roots of Eq. ^ which is a quadratic in x, vary continuously with pj and pj. 
Thus, the map Uij is continuous in \ Sij. 

The domain of Vi is contained in the domain of Uij for every j 7^ i. From part (i) of this 
Proposition, for every j ^ i, the set-valued map Uij is upper semi-continuous in S'^. Thus, for 
every j ^ i, at every q in the domain of Vi and for every e > 0, there exist 6ij > such that for 
every z G q + ;B((5jj), Uij{z) C Uij{q) + i?(e). Given an e > 0, by the choice of 6i = min{5ij,\/j ^ i}, 
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we obtain that for every z G q + B{6i), Vi{z) C Vi(q) + B{e). Thus Vi is upper semi-continuous. 
Lower semi-continuity of Vi is estabhshed similarly and the result follows. ■ 



4.2 Minimizing the Expected Constrained Travel Time 

For distinct vehicle locations, Eq. Q can be written as 

m „ 

rexp(Pl, • • • ,Pm) = / T{pi,x)<p{x)dx, 



(9) 



where Vi is the dominance region of the ith vehicle. The gradient of Tgxp is computed using the 
following formula, which allows each vehicle to compute the gradient of Texp by integrating the 
gradient of T over Vi- 

Lemma 4.5 (Gradient computation) For all vehicle configurations such that no two vehicles 
are at coincident locations, the gradient of the expected time with respect to vehicle location pi is 



^Texp f dT 



-{pi,x)(/){x)dx. 



Akin to similar results in [Bullo et al.(2009)] , the proof involves writing the gradient of Texp as a 
sum of two contributing terms. The first is the final expression, while the second is a number of 
terms which cancel out due to continuity of T at the boundaries of dominance regions. 

For z G M^, let sat : — t- denote the saturation function, i.e., if ||z|| < 1, then sat(z) = z; 
otherwise, sat(z) = z/||z||. Inspired by the established Lloyd algorithm (cf. [Bullo et al.(2009)] ), we 
present a discrete-time descent approach in Algorithm |4[ The idea is to minimize Texp by making 
each vehicle follow gradient descent over its dominance region. If the dominance region is empty, 
then the vehicle moves towards the generator, until it obtains a non-empty dominance region. 

Algorithm 4: Lloyd descent for vehicle i 

Assumes: Distinct locations {pi, . . . , pm} G £^ 
1 foreach time t G N do 

2 
3 
4 
5 



Compute Vi{t) by Algorithm |3| as a function of {pi(t), . . . , Pmit)} 
if Vi{t) is empty, then 

I Move in unit time to (Xi, Yi — min{l, Yi}); 
else 

/ f d 

For r G [t,t + 1], move according to pj(r) = — sat I / - — T(pj(r), x)(/)(x)(ix 



dpi 



Next, we define critical configurations for the vehicles, which means that every vehicle is at the 
unique minimizer of the cost evaluated over its dominance region. 

Definition 4.6 (Critical configuration) A set of locations {pi, ■ ■ ■ , Pm} is a critical configura- 
tion if, 

Pi = argmin / T{z,x)(t){x)dx, 

zeS JVi 

for alii G {!,..., m}, where {Vi, . . . , Vm} is the dominance region partition induced by {pi, . . . , Pm}- 
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We now state the main result of this section, that gives sufficient conditions under which the 
vehicles asymptotically reach a critical configuration using Algorithm |4j 

Theorem 4.7 (Convergence of Lloyd descent) Let 7 : N — )■ M^™ be the evolution of the m 
vehicles according to Algorithm and assume that no two vehicle locations become coincident in 
finite time or asymptotically. The following statements hold: 

(i) the expected travel time t ^ 7exp(7(t)) is a non-increasing function of time; 

(ii) if the dominance region Vi of any vehicle i is empty at some time, then Vi will be non-empty 
within a finite time; and 

(Hi) if there exists a time t such that every dominance region is non-empty for all times subse- 
quent to t, then the vehicle locations converge to the set of critical dominance region configurations. 

The assumptions of non-coincidence of vehicle locations and the non-emptiness of the dominance 
regions after a finite time ensure that the dominance regions are continuous functions of vehicle 
positions. The continuity of dominance regions in turn allows the LaSalle Invariance principle to 
be applicable. Further, it may be possible that the dominance region of a vehicle keeps alternating 
between being empty and non-empty under the action of Algorithm [4| However, it was observed 
through numerous simulations (e.g., see Figure [s]) that after a finite time, the dominance region of 
every vehicle remained non-empty. 



Proof: [Proof of Theorem 4.7 We begin by showing statement (i). In every iteration of 



Algorithm|4| step 2: does not increase the expected time Tgxp due to the optimality of the dominance 



region partition, by Proposition 4.3 Step 4: does not change the Texp as the associated dominance 
region is empty. Finally, step 6: does not increase ^?exp the vehicle is moving along the gradient 
descent fiow of Texp. Thus, the expected time is non- increasing under Algorithm [4[ 

Statement (ii) follows from the fact that whenever Vj = for vehicle i, due to step 4:, vehicle i 
reaches the generator after finite time and therefore has a non-empty Vi. 

For non-empty Vj, lei A : X x P([0, W\) — )• X, be the flow map of the differential equation at 
step 6: from time t to time t -|- 1. For statement (iii), consider the discrete-time dynamical system 
given by the tuple {X ,Xq.^A), where X = <S™ and Xq G £^ is the set of initial vehicle positions. 

We now apply the discrete-time LaSalle Invariance Principle (Theorem 1.19 in [Bullo et al.(2009)] ), 
for which we verify the four assumptions as follows. 

1. Existence of a positively invariant set: At every iteration of step 6:, each vehicle follows 
saturated gradient descent of a cost function belonging to the class of Eq. Q over its dominance 



region fixed for the iteration. By the first statement of Theorem 3.2 each vehicle remains in £ 
throughout the iteration, and therefore at all times. Thus, the set E"^ is positively invariant for the 
system {X ,Xq,A). 

2. Existence of a non-increasing function along A: Texp is non-increasing along A, by statement 
(i) of this theorem. 

3. Boundedness of all evolutions of {X ,Xq,A): Gradient descent keeps the X coordinates 
bounded in [0, W] . It remains to show that the y-coordinates of all vehicles remain bounded. 
Let us suppose the contrary. Then, there are two cases: (a) there exists a sequence of times on 
which at least one vehicle has its location bounded and at least one other vehicle, say vehicle k, 
has its y-coordinate growing without limits; or (b) there exists a sequence of times on which the 
y-coordinates of all vehicles grow unbounded. In case (a), after finite time, the dominance region 
Vk becomes empty, thus contradicting the assumption of statement (iii) of this theorem. If case 
(b) occurs, then there exists a subsequence of Texp which grows unbounded, thus contradicting 
statement (i) of this theorem. Thus, all evolutions of (X,Xq,A) are bounded. 

4. Continuity of Texp and A: Continuity of Tgxp follows from Eq.s ^ and Q. To verify 



continuity of A, note that whenever Vi is non-empty, by Proposition 4.4, Vi is continuous with 
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respect to vehicle locations. Thus, as long as Vj is non-empty, A is continuous as the integrand is 
continuous with respect to vehicle locations. 

By LaSalle Invariance Principle, the evolutions of {X,Xo,A) converge to a set of the form 
T^p{k) n Ai, where k is a real constant and A4 is the largest positively invariant set in {x G 

-^exp("^(2^)) — ^exp(^)}' Since Texp remains constant under action of A for the set of critical 
configurations, it is contained in a set of the form T'g~p(«;) H Ai. If a set of vehicle positions is not 
critical, then Texp strictly decreases under the action A, and therefore the set of vehicle positions is 
not contained in a set of T^p{K)r\Ai. Thus, the vehicles converge to the set of critical configurations. 

■ 

The next result gives a simple condition to identify an unstable critical configuration, which is 
an unstable equilibrium of Algorithm |4j Figure [7| illustrates this result. 

Lemma 4.8 (Disconnected partitions are unstable) A critical configuration is unstable if some 
vehicle has a disconnected dominance region. 

The proof involves perturbing the position of a vehicle with a disconnected dominance region, 
and then showing that the gradient in the X direction for that vehicle takes the vehicle away from 
the equilibrium configuration. 



4.3 Simulations 



We now present some simulations of Algorithm [4} 

Examples of critical locations: We consider two vehicles, and a uniform target generation density, 
i.e., = 1/W. From initial locations such as in the leftmost of Figure [7| wherein both vehicles 
having the same X-coordinate of W/2, but different y-coordinates, the vehicles asymptotically 
approach the configuration in the center figure. However, a small perturbation to the vehicles leads 



to the configuration in the rightmost figure. Thus, this simulation illustrates Lemma 4.8 However, 
from most initial conditions, the vehicles converged to a critical configuration as in the rightmost 
figure. 




Figure 7: Algorithm |4] for uniform arrival density. The thick solid (red) and the thin solid (blue) 
dominance regions belong to the square and the round vehicles respectively. The vehicles first tend 
to an critical configuration (center figure). A perturbation to their positions makes them move to 
a stable critical configuration. 

Non-uniform probability distribution: We consider three vehicles and the arrival probability density 
function, 



(t>{x) 



fSx/W^, if X e [0,VF/4], 

[2/W-8ix- W/i)/i3W'^), if X G ]T^/4, VF]. 
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Initially, the round vehicle had an empty dominance region (Figure [8| left). After finite time, 
the round vehicle obtained a non-empty dominance region (Figure |8| center), after which all vehicles 
continued to have non-empty dominance regions. Thus, by Theorem |4.7[ the vehicles converged to 
a critical configuration (Figure [sj right). 




Figure 8: Algorithm |4] for non- uniform arrival density (black line). The dashed dominance region 
belongs to the triangle vehicle. Initially, the round vehicle has no dominance region. 

4.4 Adversarial target motion: An insight 

We now show that the partitioning procedure can be applied to the case of adversarial target. 
However, the dominance regions are difficult to characterize analytically. To see this, consider only 
two vehicles pi and p2, and suppose the target is generated at q. In order to maximize the vertical 
height (resp. intercept time), the optimal strategy for the target is (cf. [Isaacs(1965)| ): 

(i) Compute the Apollonius circles (AGs) with respect to the pursuer locations pi and P2. 

(ii) Move to the point with highest Y coordinate (resp. furthest point) in the intersection of 
the AGs. 

The strategy is illustrated in Figure [oj We partition the generator into: (i) Vi (resp. V2): Set 
of all locations q for which the AG of the target with respect to pursuer pi (resp. P2) is entirely 
contained in the AG with respect to pursuer p2 (resp. pi); and (ii) Vi,2 G\ (Vi U V2). 



P2 PI 




(a) q G Vi. Vehicle p2 need (b) q G Vi,2- Both vehicles 

not move. must move towards I. 



Figure 9: Generator partitioning to intercept an adversarial target. 
The optimal pursuit strategy is to move pi if q G Vi, for some i G {1,2}, and to move both pi 
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and p2 if q G Vi,2- The average cost Cexp(pi,P2) can be written as 

2 



Cexp = / C{pi,x)(l){x)dx + / C(pi,P2, 



x)(l){x)dx. 



The gradient of the first term is similar to that in Lemma 4.5 But, the second term C(pi, P2, a;) 
is difficult to characterize in the form of an analytical expression. Thus, the adversarial case is a 
challenging future direction. 



5 Conclusions and Future Directions 



We addressed the problem of optimally placing vehicles having simple motion in order to intercept 
a mobile target that arrives stochastically on a line segment. For a single vehicle, we determined 
unique optimal placements when target motion was either constrained, i.e., with fixed speed and 
direction, or adversarial. For the multiple vehicle scenario and with constrained motion targets, we 
characterized conditions under which a partition and gradient based algorithm takes the vehicles 
asymptotically to the set of critical points of the cost function. 

A future direction is to consider numerical methods for the multiple vehicles with adversarial 
targets. Another direction is to consider stochastic target motion. 
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Appendix 

In this Appendix, we provide complete proofs of Lemmas 3.1 4.5 and 4.8 



Proof of Lemma \3.1\ The first claim follows by verifying that the Hessian matrix of C with respect 
to X and Y is positive semi-definite in the domain ]0, x M>o. 

For the second claim, we need to show existence and uniqueness of a minimizer in the domain 
]0,I^[xM>o. 

1. Existence: We show that a minimizer cannot lie on the boundary or outside of the domain 
[0, W] X M>o. We begin by showing that Y* exists and is finite. Taking the limit of Cey.-p{X,Y) as 
Y +00, 

l-w 

liminf Ccxp(^, ^) > liminf(a — c)Y / (f){x)dx = +oo, 

Y^+oo Y-¥+oo Jq 

since by assumption, a > c. Thus, Y* exists and is finite. 

Finally, to show that a minimizer lies in ]0,VF[ x M>o, we need to prove two statements: (a) 
Y* 7^ 0, and (b) X* G ]0, W[. To show (a), Eq. ^ along with the assumption <p{x) < M, for every 
X e [0,W], yields 

< MYa 



dY - Jq ^h{X - x)2 + y2 

< ^^(log(W^ + ^JW^+Y^b) - \og{Y/Vb)) - c. 

Thus, limsupy_s.o+ SC'exp/f^^ — Thus, for Y near zero, the gradient of Ccxp points in the 
negative y-direction, implying that Y* ^ 0. 
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To show (b), we first observe that for a given Y, in the hmit as X — )• ±00, Cexp — ^ +00, and 
therefore X* must be bounded. Finally, the claim follows since the partial derivative of Cexp with 
respect to X is strictly negative for X <0 and is strictly positive for X >W. 

Facts (a) and (b) coupled with convexity of Cexp with respect to X and Y establish the existence 
part. 

2. Uniqueness: Let there be two locations {Xi,Yi) and (X2,l2) that minimize the expected 
cost. Since the expected cost Cexp is convex in X and Y, a convex combination of {Xi,Yi) and 
{X2,Y2) also minimizes Cexp- Thus, the necessary conditions for minimum are satisfied by 
{X{a),Y{a)) := {aXi + (1 - a)X2,aYi + (1 - 0)^2), for every a G [0, 1]. Thus, 

{X{a) -x)(l){x) 



y^{bX{a)-xy + Y{a) 



dx = 0, 



^ Y{a)(l){x) , c 

/o ^b{X{a)-x)^ + Y{a)^ a' 

Since the above conditions hold for every a £ [0, 1], the partial derivatives of the above conditions 
evaluated at a = 0, must equal zero, which yields 

{X2 - x)Y2{Y, - Y2) - YjjXr - X2) 

{h{X2 - xY + y|)3/2 = 0' 

^ {X2 - x)Y2{Xr - X2) - {Y - Y2){X2 - X? 

(b{X2-xy + Yi)y^ '^^^^^^ 

= 0, 

where (/.(a;)/(6(X2 - xf + Y^f/^ =: /(X2,y2 , x) is strictly positive for I2 > 0. Multiplying the 
first equation by {Xi — X2), the second by (Yi — I2), and adding the equations, 

f-W 

/ fiX2,Y2,x){Y2{Xi - X2) - iX2 - x)(Yi - Y2)fdx = 0. 
Jo 

Since f{X2,Y2,x) > 0, we must have y2(-'^i — X2) — {X2 — x){Yi — Y2) = 0, for every x at which 
f{X2, Y2,x) > 0, which is feasible only if Xi - X2 = and Yi - 12 = 0. 

Parts 1 and 2 complete the proof for the second claim. ■ 



Proof of Lemma 4-5: Let pj be termed as a neighbor of pi, i.e., j G neigh(i), if ViHVj is non-empty. 
Then, 



aTexp ^ ^ 

dpi dp 



- [ T{pi,x)(pix)dx + ^ [ T{pj,x)(j){x)dx, 

3 neigh (i) ^ 

Now, let Vi = Ui=i nM'i-> ^']' some finite integer rij. Then, there are two cases: 

1. Every boundary point in the interior of [0, W] belong to the dominance region of exactly two 
vehicles: In this case, all boundary points ai and bi are differentiable with respect to pj. Therefore, 
by Leibnitz's Rul^ 

— j^ T{p,,x)mdx = j^^ ^(p.,x)0(x)d:r + gr(p„6,)^ -r(p„a,)^. 



Leibnitz's Rule: 

— / f(z,x)dx^ — '-dx + f(z,b)^^ - f(z,a)^^ 

OZ Ja{z) Ja(z) OZ dz dz 
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Unless ai = 0, or = W (in which case the partial derivatives with respect to Pi are zero), for 
every / E {1, . . . , rij}, there exist some j £ neigh(i) and some k £ neigh(i), such that 



and, 



dp 

d 



i JV. 



T{pj,x)(j){x)dx = -T{pj,bi) 
T{pk,x)(j){x)dx = T{pk,ai 



dpi' 

dai 



(10) 



where we have made use of Leibnitz's Rule. Due to the continuity of T at the boundary points, we 
obtain 

TiPj, h) = T{pi, bi), T(pfc, ai) = T(pi, a;), 

and on summation. 



E 



je neigh (i) 



dp 



I JV. 



T{pj , x)(j){x)dx + r(pi, - T(pi, a/) 1^ 

f-' dpi dpi 



0. 



The proof is complete for this case. 

2. Some hi (or ai) belongs to the dominance regions ofpi and at least two other vehicles: Let pj 
and Pr be two of these vehicles. We perturb the position of pi in a direction v by a small distance 
e. We claim that the boundary term T{pi, bi)dbi/ dpi is cancelled independent of the choice of the 
direction v. The following two possibilities arise (cf. Figure 10): either the point bi moves to the 
right or bi moves to the left by some distance 6{e). The steps for the former possibility are exactly 
identical to Case 1. In the latter possibility, we can write Eq. (10), if the interval \bi — 5, bi] belongs 
to Vj{pi, . . . ,pi + ev, . . . , Pm), or we can write Eq. ( 10) with j replaced by r, if the interval [bi — 6, bi] 
belongs to Vr(pi, . . . ,Pi + ev, . . . , Pm)- Thus, in both of these possibilities, the steps from case 1 
apply leading to the cancellation of all the boundary terms. 

This completes the proof. ■ 



Proof of Lemma 4-8' We first prove the result for the case of two vehicles. Let {Pi,P2} be a 
critical dominance region configuration in which pi has its dominance region disconnected. Let the 
dominance regions be 

Vi = [A,B], V2 = [0,A]U[B,W]. 



Perturb pi by a small distance 6Xm the positive X direction, as shown in Figure 11 From 
continuity of the dominance regions, we have 

Vi = [A- 6A, B-6B],V2 = [0, A-6A]U[B- 6B, W], 

where 6 A and 5B are positive and sufficiently small. Let hix, X2, 1^2) := {X2—x)4>{x) / \/ {1 — v'^){X2 — x)^ + ¥2- 
Evaluating the partial derivatives in X for p2. 



(1 



2^9 



B-SB 



hdx, 



Upon further simplification. 



m 

dX 



A 

ASA 
A 

ASA 



ASA 



B 



hdx + / hdx 



b 

B-5B 



hdx 



hdx 



B 



hdx, 



BSB 



(11) 
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Figure 10: Illustration of case 2 in the proof of Lemma 4.5 In the first figure, the point bi belongs 
to the dominance regions of Pi, pj and p,.. The second and third figures show how the dominance 
regions would change when pj is perturbed in different directions. The thick solid, the dashed and 
the thin solid dominance regions belong to the square (red), the triangle (green) and the round 
(blue) vehicles, respectively. 




Figure 11: Illustrating instability of critical dominance region configuration having a disconnected 
dominance region. 



as the sum of the first two terms is zero from the necessary condition for pg to be a minimum. For 
sufficiently small SX, there exist 6A and 5B such that /2 > on the interval [0, A — 5 A] and I2 < 
on the interval [B — 5B,B], since X2 — x > and X2 — x < respectively on the two intervals. 
Thus, dT2/dX > when pi is displaced to {Xi + 6X, Yi), which implies the direction of gradient 
descent in X is the negative X direction for p2, and similarly is the positive X direction for pi. 
Thus, the critical configuration is unstable. 

In the case of m > 2 vehicles, let the dominance regions of pi and p2 share at least one point. 
Since both terms on the right hand side of Eq. (11) are positive, the direction of gradient descent 
in X is the negative direction for p2 independent of the fact whether the dominance regions of pi 
and p2 share one or two common points. ■ 
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